LaDIVA: A neurocomputational model providing laryngeal motor control for speech acquisition and production

Many voice disorders are the result of intricate neural and/or biomechanical impairments that are poorly understood. The limited knowledge of their etiological and pathophysiological mechanisms hampers effective clinical management. Behavioral studies have been used concurrently with computational models to better understand typical and pathological laryngeal motor control. Thus far, however, a unified computational framework that quantitatively integrates physiologically relevant models of phonation with the neural control of speech has not been developed. Here, we introduce LaDIVA, a novel neurocomputational model with physiologically based laryngeal motor control. We combined the DIVA model (an established neural network model of speech motor control) with the extended body-cover model (a physics-based vocal fold model). The resulting integrated model, LaDIVA, was validated by comparing its model simulations with behavioral responses to perturbations of auditory vocal fundamental frequency (fo) feedback in adults with typical speech. LaDIVA demonstrated capability to simulate different modes of laryngeal motor control, ranging from short-term (i.e., reflexive) and long-term (i.e., adaptive) auditory feedback paradigms, to generating prosodic contours in speech. Simulations showed that LaDIVA’s laryngeal motor control displays properties of motor equivalence, i.e., LaDIVA could robustly generate compensatory responses to reflexive vocal fo perturbations with varying initial laryngeal muscle activation levels leading to the same output. The model can also generate prosodic contours for studying laryngeal motor control in running speech. LaDIVA can expand the understanding of the physiology of human phonation to enable, for the first time, the investigation of causal effects of neural motor control in the fine structure of the vocal signal.Fil: Weerathunge, Hasini R.. Boston University; Estados UnidosFil: Alzamendi, Gabriel Alejandro. Universidad Nacional de Entre Ríos. Instituto de Investigación y Desarrollo en Bioingeniería y Bioinformática - Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Santa Fe. Instituto de Investigación y Desarrollo en Bioingeniería y Bioinformática; ArgentinaFil: Cler, Gabriel J.. University of Washington; Estados UnidosFil: Guenther, Frank H.. Boston University; Estados UnidosFil: Stepp, Cara E.. Boston University; Estados UnidosFil: Zañartu, Matías. Universidad Técnica Federico Santa María; Chil

Ability-Based Methods for Personalized Keyboard Generation

This study introduces an ability-based method for personalized keyboard generation, wherein an individual's own movement and human-computer interaction data are used to automatically compute a personalized virtual keyboard layout. Our approach integrates a multidirectional point-select task to characterize cursor control over time, distance, and direction. The characterization is automatically employed to develop a computationally efficient keyboard layout that prioritizes each user's movement abilities through capturing directional constraints and preferences. We evaluated our approach in a study involving 16 participants using inertial sensing and facial electromyography as an access method, resulting in significantly increased communication rates using the personalized keyboard (52.0 bits/min) when compared to a generically optimized keyboard (47.9 bits/min). Our results demonstrate the ability to effectively characterize an individual's movement abilities to design a personalized keyboard for improved communication. This work underscores the importance of integrating a user's motor abilities when designing virtual interfaces.Comment: 20 pages, 7 figure

Quantitative MRI reveals differences in striatal myelin in children with DLD.

Developmental language disorder (DLD) is a common neurodevelopmental disorder characterised by receptive or expressive language difficulties or both. While theoretical frameworks and empirical studies support the idea that there may be neural correlates of DLD in frontostriatal loops, findings are inconsistent across studies. Here, we use a novel semiquantitative imaging protocol - multi-parameter mapping (MPM) - to investigate microstructural neural differences in children with DLD. The MPM protocol allows us to reproducibly map specific indices of tissue microstructure. In 56 typically developing children and 33 children with DLD, we derived maps of (1) longitudinal relaxation rate R1 (1/T1), (2) transverse relaxation rate R2* (1/T2*), and (3) Magnetization Transfer saturation (MTsat). R1 and MTsat predominantly index myelin, while R2* is sensitive to iron content. Children with DLD showed reductions in MTsat values in the caudate nucleus bilaterally, as well as in the left ventral sensorimotor cortex and Heschl's gyrus. They also had globally lower R1 values. No group differences were noted in R2* maps. Differences in MTsat and R1 were coincident in the caudate nucleus bilaterally. These findings support our hypothesis of corticostriatal abnormalities in DLD and indicate abnormal levels of myelin in the dorsal striatum in children with DLD

Multidimensional scaling plots of nonerror productions for all participants (Cler et al., 2017)

Example multidimensional scaling (MDS) plots of nonerror productions for all participants. Each data point indicates one nonerror syllable production, color coded by syllable class. Distance between points is monotonically related to the L1-norm distance between high-dimensional kinematic feature vectors recorded and resampled for each syllable. Blue diamonds: /bi/, green circles: /bu/, orange stars: /da/, black triangles: /du/, purple arrows: /za/, red squares: /zi/. Lighter markers indicate trials produced under delay, while dark markers show trials with no delay.<div><br></div><div>Cler, G. J., Lee, J. C., Mittelman, T., Stepp, C. E., & Bohland, J. W. (2017). Kinematic analysis of speech sound sequencing errors induced by delayed auditory feedback. <i>Journal of Speech, Language, and Hearing Research</i>, <i>60</i>(6S), 1695–1711. <div><br></div><div><br></div></div

Video displaying game and nasal accelerometer (Cler et al., 2017)

Video shows game and nasal accelerometer used in this study. Users play the game as a ninja fighting evil robots by using just their speech. Game play for feedback and no-feedback stages are identical: a robot appears, and the user is prompted to repeat one of the stimuli CVCs (e.g., mom, nun, bag, bead) three times. Feedback stages prompted participants to increase their nasalization on nasal stimuli and decrease their nasalization on nonnasal stimuli, as shown in the video.<div><br></div><div>Cler, G. J., Mittelman, T., Braden, M. N., Woodnorth, G. H., & Stepp, C. E. (2017). Video game rehabilitation of velopharyngeal dysfunction: A case series. <i>Journal of Speech, Language, and Hearing Research, 60</i>(6S), 1800–1809.<br><div><br></div><div><br></div></div

Functional organisation for verb generation in children with developmental language disorder

Developmental language disorder (DLD) is characterised by difficulties in learning one's native language for no apparent reason. These language difficulties occur in 7% of children and are known to limit future academic and social achievement. Our understanding of the brain abnormalities associated with DLD is limited. Here, we used a simple four-minute verb generation task (children saw a picture of an object and were instructed to say an action that goes with that object) to test children between the ages of 10–15 years (DLD N = 50, typically developing N = 67). We also tested 26 children with poor language ability who did not meet our criteria for DLD. Contrary to our registered predictions, we found that children with DLD did not have (i) reduced activity in language relevant regions such as the left inferior frontal cortex; (ii) dysfunctional striatal activity during overt production; or (iii) a reduction in left-lateralised activity in frontal cortex. Indeed, performance of this simple language task evoked activity in children with DLD in the same regions and to a similar level as in typically developing children. Consistent with previous reports, we found sub-threshold group differences in the left inferior frontal gyrus and caudate nuclei, but only when analysis was limited to a subsample of the DLD group (N = 14) who had the poorest performance on the task. Additionally, we used a two-factor model to capture variation in all children studied (N = 143) on a range of neuropsychological tests and found that these language and verbal memory factors correlated with activity in different brain regions. Our findings indicate a lack of support for some neurological models of atypical language learning, such as the procedural deficit hypothesis or the atypical lateralization hypothesis, at least when using simple language tasks that children can perform. These results also emphasise the importance of controlling for and monitoring task performance